Closed form transient solution of continuous time Markov chains through uniformization
نویسنده
چکیده
This paper derives a mapping between a close form transient solution of a continuous time Markov chain (CTMC), and a close form transient solution of one of its uniformized discrete time Markov chains. This result is used to propose a new method to compute the transient solution of CTMCs. The method is simple to implement and has important benefits: (i) It yields a closed-form solution. (ii) It can be used to compute the transient solution for general CTMCs (even with absorbing states, or defective matrices). (iii) It can be used even for chains having a large number of states.
منابع مشابه
Numerical Solution of Non-Homogeneous Markov Processes through Uniformization
Numerical algorithms based on uniformization have been proven to be numerically stable and computationally at tractive to compute transient state distributions in ho mogeneous continuous time Markov chains Recently Van Dijk van Dijk formulated uniformization for non homogeneous Markov processes and it is of interest to investigate numerical algorithms based on uniformiza tion for non homogeneou...
متن کاملSERIE RESEHRCH mEmORBnDH APPROXIMATE UNIFORMIZATION FOR CONTINUOUS-TIME MARKOV CHAINS WITH AN APPLICATION TO PERFORMABILITY ANALYSIS
An approximate version of the Standard uniformization technique is introduced for application to continuous-time Markov chains with unbounded jump rates. This technique is shown to be asymptotically exact and an error bound for the order of its accuracy is provided. An illustrative queueing application is included.
متن کاملNumerical Methods for Reliability Evaluation of Markov Closed Fault-Tolerant Systems - Reliability, IEEE Transactions on
Conclusions This paper compares three numerical methods for reliability calculation of Markov, closed, fault-tolerant systems which give rise to continuous-time, timehomogeneous, finite-state, acyclic Markov chains. We consider a modified version of Jensen’s method (a probabilistic method, also known as uniformization or randomization), a new version of ACE (Acyclic Markov Chain Evaluator) algo...
متن کاملSERIE RESEARCH mEmORIMDH A NOTE ON EXTENDED UNIFORMIZATION FOR NON-EXPONENTIAL STOCHASTIC NETWORKS
The Standard uniformization technique for continuous-time Markov chains is generalized to non-exponential stochastic networks.
متن کاملMonotonicity and Convexity of Some Functions Associated with Denumerable Markov Chains and Their Applications to Queueing Systems
Motivated by various applications in queueing theory, this paper is devoted to the monotonicity and convexity of some functions associated with discrete-time or continuous-time denumerable Markov chains. For the discrete-time case, conditions for the monotonicity and convexity of the functions are obtained by using the properties of stochastic dominance and monotone matrix. For the continuous-t...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2013